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TITLE OF THE INVENTION 

Coding Apparatus, Coding Method And Recording Medium Having Coded Program 
Recorded Therein, And Decoding Apparatus, Decoding Method And Recording 
Medium Having Decoded Program Recorded Therein 
BACKMobile OF THE INVENTION 
Field of the Invention 

The present invention relates to a coding apparatus for carrying out serial 
concatenated trellis coded modulation, a coding method and a recording medium 
having a coded program recorded therein, and a decoding apparatus for decoding data 
subjected to serial concatenated trellis coded modulation, a decoding method and a 
recording medium having a decoded program recorded therein. 
Description of Related Art 

Lately, the study on, for example, a communication field such as a mobile 
communication and a deep space communication, a broadcasting field such as 
terrestrial wave or satellite digital broadcasting, and a magnetic, light or photo-electro 
recording field has been progressed materially, but with this, the study on a code 
theory for the purpose of making error correction coding and decoding efficient has 
been carried out actively. 

As a theoretical limit of code performance, a Shannon limit implied by a so- 
called Shannon 's channel coding theorem is known. 

As the coding method indicative of the performance close to the Shannon limit, 
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there is known a coding method by serially concatenated convolutional codes 
described in, for example, [S. Benedetto, G. Montorsi, D. Divsalar, F. Pollara, "Serial 
Concatenation of Interleaved Codes: Performance Analysis, Design, and Iterative 
Decoding", TDA Progress 42-126, Jet Propulsion Laboratory, Pasadens, California, 
Aug. 15, 1996]. 

The coding by the serially concatenated convolutional codes is carried out by 
an apparatus having two convolutional coders and aninterleaver serially concatenated. 
The decoding by the serially concatenated convolutional codes is carried out by an 
apparatus having two decoding circuits for outputting a soft-output serially 
concatenated, and information is transferred between the two decoding circuits to 
obtain the final decoded result. 

Further, as an application of the coding by the serially concatenated 
convolutional codes, there is also known a serial concatenated trellis coded 
modulation, which is hereinafter referred to as SCTCM, described in, for example, [D. 
Divsalar, F. Pollars, "Serial and Hybrid Concatenation Codes with Applications", in 
Proc, Int. Symp. On Turbo Codes and Related Topics, Brest, France, pp. 80-87, Sept. 
1997]. The SCTCM system comprises a combination of the coding by the serially 
concatenated convolutional codes and a multi-value modulation, which collectively 
considers an arrangement of a signal point of a modulation signal and the decoding 
feature of an error correction code. 

In this reference, the coding apparatus for carrying out coding according to the 
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SCTCM system, when input data of 4-bit is input, carries out convolutional operation 
whose code rate is "4/5" as coding of a first code (hereinafter referred to an outer 
code) by a convolutional coder with respect to input data, applies interleave to coded 
data of 5-bit as the operation result, after which, carries out convolutional operation 
whose coded rate is "5/6" as coding of a second code (hereinafter referred to an inner 
code) by a convolutional coder with respect to input data, mapping coded data of 6-bit 
as the operation result to a transmission symbol of a predetermined modulation 
system, and outputs the produced transmission symbol the outside every coded 
transmission symbol. That is, this coding apparatus carries out convolutional operation 
whose code rate is "4/5" as coding of an outer code, and carries out convolutional 
operation whose code rate is "5/6" as coding of an inner code, whereby carrying out 
the serial concatenated convolutional operation whose code rate is "(4/5) x (5/6) =4/6 
= 2/3" as a whole. On the other hand, the decoding apparatus for carrying out decoding 
of codes of the SCTCM system by the coding apparatus, when a reception word is 
received, iteratively carries out decoding operation between two soft-output decoding 
circuits, for example, by the predetemiined number of times such as several times to 
scores of tunes, and outputs decode data on the basis of exterinsic information of soft- 
output obtained as a result of the predetennined number of times of the decoding 
operation. 

As the coding apparatus for carrying out coding according to th SCTCM system 
and the decoding apparatus for carrying out decoding according to th SCTCM system, 
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apparatuses shown below have been also proposed. In the following, the coding 
apparatus for carrying out coding according to th SCTCM system and the decoding 
apparatus for carrying out decoding according to th SCTCM system will be explained. 
In the following description, a contemplation is made of a case in which as shown in 
FIG. 1, digital information is subjected to serially concatenated convolutional coding 
by a coder 201 provided on a transmission device not shown, which output is input 
into a receiver not shown through a memoryless channel 202 with noises, which is 
decoded by a decoder 203 provided on the receiver. 

As the coding apparatus 20 1 for carrying out coding according to th SCTCM 
system, there has been proposed an apparatus comprising a convolutional coder 210 
for carrying out coding of a first code (hereinafter referred to as an outer code), an 
interleaver 220 for rearranging order of data input, a convolutional coder 230 for 
carrying out coding of a second code (hereinafter referred to as an inner code), and 
a multi-value modulation mapping circuit 240 for carrying out mapping of a signal 
point on the basis of a predetermined modulation system, as shown in FIG. 2. The 
coding apparatus 201 carries out serially concatenated convolutional operation whose 
code rate is "2/3" with respect to input data D201 of 2-bit input, which is converted 
to code data D204 of 3-bit and subjected to mapping to, for example, a transmission 
symbol of a 8 PSK (8-Phase Shift Keying) modulation system to output it as a code 
transmission symbol D205 of 3-bit. 

The convolutional coder 210, when input data D20 1 of 2-bit is input, carries out 
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convolutional operation with respect to the input data D20 1 , and outputs the operation 
result to an interleaver 220 in the later stage as code data D202 of 3-bit. That is, the 
convolutional coder 210 carries out convolutional operation whose code rate is "2/3" 
as coding of an outer code, and outputs the code data D202 to the interleaver 220 in 
the later stage. 

The interleaver 220 inputs the code data D2 02 comprising three bit series output 
from the convolutional coder 210, rearranges order of bits constituting the code data 
D202, and outputs the produced interleave data D203 to a convolutional coder 230 in 
the later stage. 

The convolutional coder 230, when the interleave data D203 of 3-bit is input, 
carries out convolutional operation with respect to the interleave data D203, and 
outputs the operation result to a multi-value modulation mapping circuit 240 in the 
later stage as code data D204 of 3-bit. That is, the convolutional coder 230 carries out 
convolutional operation whose code rate is "3/3=1" as coding of an inner code and 
outputs the code data D204 to the multi-value modulation mapping circuit 240 in the 
later stage. 

The multi-value modulation mapping circuit 240 causes the code data D204 
output from the convolutional coder 230 to synchronize with a clock to map it to a 
transmission symbol of a 8PSK modulation system, for example. Since a signal point 
of one transmission symbol in the 8SPSK modulation system is data of 3 -bit, the 
multi-value modulation mapping circuit 240 maps the code data D204 of 3-bit output 
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from the convolutional coder 230 as one transmission symbol to produce one code 
transmission symbol D205. The multi-value modulation mapping circuit 240 outputs 
the produced code transmission symbol D205 outside. 

As described above, the coding apparatus 201 carries out convolutional 
operation whose code rate is "2/3" as coding of an outer code by the convolutional 
coder 210, and convolutional operation whose code rate is "1" as coding of an inner 
code is carried out by the convolutional coder 230 to thereby carry out the serially 
concatenated convolution operation whose code rate is "(2/3) x 1=2/3" as a whole. 
Data code and modulated by the coding apparatus 20 1 is output to the receiver through 
the memoryless channel 202. 

On the other hand, as the decoding apparatus 203 for carrying out decoding of 
codes of the SCTCM system by the coding apparatus 201, there has been proposed an 
apparatus comprising a soft-output decoding circuit 250 for carrying out decoding of 
an inner code, a deinterleaver 260 for returning order of data input to the original, an 
interleaver 270 for rearranging order of data input, and a soft-output decoding circuit 
280 for carrying out decoding of an outer code, as shown in FIG. 3, for example. The 
decoding apparatus 203 takes an analog value due to the influence of noises generated 
on the memoryless channel 202, and presumes the input data D201 in the coding 
apparatus 201 from the reception word D206 to be a soft-input to output it as decode 
data D211. 

The soft-output decoding circuit 250 is provided corresponding to the 
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convolutional coder 230 in the coding apparatus 20 1 to carry out MAP (Maximum A 
Posteriori probability) decoding based on the so-called BCJR (Bahl, Cocke, Jelinek 
and Raviv) algorithm. The soft-output decoding circuit 250 inputs the soft-input 
reception word D206 received by the receiver, inputs priori probability information 
D207 with respect to soft-input information bits supplied from the interleaver 270, and 
carries out soft-output decoding of an inner code using these reception word 206 and 
priori probability information D207. The soft-output decoding circuit 250 produces 
exterinsic information D208 with respect to the information bits obtained under the 
constraint conditions of codes, and outputs the exterinsic information D208 to the 
deinterleaver 260 in the later stage as a soft-output. The exterinsic information D208 
corresponds to the interleave data D203 interleaved by the interleaver 220 in the 
coding apparatus 201. 

The deinterleaver 260 applies the deinterleave to the soft-input exterinsic 
information D208 output from the soft-output decoding circuit 250 so that a bit array 
of the interleave data D203 interleaved by the interleaver 220 in the coding apparatus 
201 is returned to a bit array of the original code data D202. The interleaver 260 
outputs data obtained by interleaving as the priori probability information D209 with 
respect to signal bits in the soft-output decoding circuit 280 in the later stage. 

The interleaver 270 applies the interleave based on the same exchange position 
information as the interleaver 220 in the coding apparatus 201 with respect to the 
exterinsic information D210 relative to the soft-input code bit output from the soft- 
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output decoding circuit 280. The interleaver 270 outputs data obtained by interleaving 
as the priori probability information D207 with respect to information bits in the soft- 
output decoding circuit 250. 

The soft-output decoding circuit 280 is provided corresponding to the 
convolutional coder 210 in the coding apparatus 201 to carry out the MAP decoding 
and SOVA decoding based on the BCJR algorithm described above, similarly to the 
soft-output decoding circuit 250. The soft-output decoding circuit 280 inputs priori 
probability information D209 with respect to the soft-input code bit output from the 
demterleaver 260, inputs priori probability information whose value is "0", though not 
shown, and carries out soft-output decoding of an outer code using the priori 
probability information. The soft-output decoding circuit 280 produces exterinsic 
information D210 with respect to the code bit obtained under the constraint condition 
of codes, and outputs the exterinsic information D210 as a soft-output to the 
interleaver 270. Further, the soft-output decoding circuit 280 produces exterinsic 
information with respect to information bit obtained under the constraint condition of 
codes, and outputs decode data D211 of hard-output on the basis of the exterinsic 
information. 

The decoding apparatus 203 as described above, when the reception word is 
received, iteratively carries out decoding operation of the soft-output decoding circuit 
250 to the soft-output decoding circuit 280 by the number of predetermined times, for 
example, such as several times to scores of times to output the decode data D21 1 on 
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the basis of the soft-output exterinsic information obtained as a result of the number 
■\ of predetermined times of decoding operation. 

As described above, in the system constituted by the coding apparatus 20 1 and 
the coding apparatus 203, the coding according to the SCTCM system and the 
decoding according to the SCTCM system can be carried out. 

Incidentally, the conventional actual conditions were that in the system 
comprising the aforementioned coding apparatus 20 1 and the decoding apparatus 203, 
the error correction coding and decoding according to the SCTCM system can be 
carried out under the high coding rate, but there remains room of improvement in 
terms of the performance. 

--!! SUMMARY OF THE INVENTION 

= The present invention has been accomplished in view of the actual conditions 

^ as noted above. It is an object of the present invention to provide a coding apparatus 
; capable of carrying out coding and decoding under the high performance, a coding 
method and a recording medium having a code program recorded therein, and a 
decoding apparatus, a decoding method and a recording medium having a decode 
program recorded therein. 

A coding apparatus according to the present invention for achieving the 
aforementioned object is a coding apparatus for carrying out serially concatenated 
code modulation with respect to data input comprising: a first coding means for 
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carrying out coding whose code rate is k/(k+l) with respect to data of k-bit input; a 
first interleaving means for interleaving order of bits constituting data comprising a bit 
series of (k+1) bits coded by the first coding means; at least one or more second 
coding means serially concatenated with the later stage away from the first interleaving 
means to carry out coding whose code rate is 1 with respect to data of (k+1) bit input; 
at least one or more second interleaving means serially concatenated with the 
respective ones of the at least one or more second coding means to interleave order of 
bits constituting data comprising a bit series of (k+1) bits coded by the second coding 
means in the first stage; a third coding means serially concatenated with the second 
interleaving means in the final stage to carry out coding whose code rate is 1 with 
respect to data of (k+1) bit input; and a mapping means for mapping data of (k+1) bit 
coded by the third coding means to a transmission symbol of a predetermined 
modulation. 

Further, a coding method according to the present invention for achieving the 
aforementioned object is a coding method for carrying out serially concatenated code 
modulation with respect to data input comprising: a first coding step for carrying out 
coding whose code rate is k/(k+l) with respect to data of k-bit input; a first 
interleaving step for interleaving order of bits constituting data comprising a bit series 
of (k+1) bits coded by the first coding step; a coding processing step for carrying out 
at least one or more processes including a second coding step for carrying out coding 
whose code rate is 1 with respect to data of (k+1) bit input; and a second interleaving 
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step for interleaving order of bits constituting data comprising a bit series of (k+ 1 ) bits 
coded by the second coding step; a third coding step for carrying out coding whose 
code rate is 1 with respect to data of (k+ 1 ) bit processed by the coding processing step; 
a mapping step for mapping data of (k+1) bit code by the third coding step to a 
transmission symbol of a predetermined modulation. 

Furthermore, a decoding apparatus according to the present invention for 
achieving the aforementioned object is a decoding apparatus for carrying out decoding 
of codes subjected to serially concatenated code modulation by coding equipment 
comprising: a first coding means for carrying out coding whose code rate is k/(k+l) 
with respect to data of k-bit input; a first interleaving means for interleaving order of 
bits constituting data comprising a bit series of (k+1) bits coded by the first coding 
means; at least one or more second coding means serially concatenated with the later 
stage away from said first interleaving means to carry out coding whose code rate is 
1 with respect to data of (k+1) bit input; at least one or more second interleaving 
means serially concatenated with the respective ones of said at least one or more 
second coding means to interleave order of bits constituting data comprising a bit 
series of (k+ 1 ) bits coded by the second coding means in the first stage; a third coding 
means serially concatenated with the second interleaving means in the final stage to 
carry out coding whose code rate is 1 with respect to data of (k+1) bit input; and a 
mapping means for mapping data of (k+1) bit coded by the third coding means to a 
transmission symbol of a predetermined modulation, the decoding apparatus 
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comprising: a first soft-output decoding means provided corresponding to the third 
coding means to carry out soft-output decoding using a reception word which is a soft- 
input input, and priori probability information with respect to information bits of 
(k+1) bits which is a soft-input input; at least one or more first deinterleaving means 
serially concatenated with the later stage away from the first soft-output decoding 
means to rearrange data of (k+1 ) bits of a soft-input input so that a bit array of data of 
(k+1) bits rearranged by the second interleaving means is returned to a bit array of data 
of (k+1) bits coded by the second coding means; at least one or more second soft- 
output decoding means provided corresponding to the respective ones of the at least 
one or more second coding means and serially concatenated with the respective ones 
of the at least one or more first deinterleaving means to carry out soft-output decoding 
using priori probability infonnation with respect to code bits of (k+1) bits which are 
a soft-input output from the first deinterleaving means, and priori probability 
information with respect to infonnation bits of (k+1) bits which are a soft-input input; 
one or more third interleaving means for interleaving order of bits constituting data 
comprising a bit series of (k+1) pieces of a soft-input output from the respective ones 
of the at least one or more second soft-output decoding means on the basis of the same 
exchange position information as that of the second interleaving means; a second 
deinterleaving means serially concatenated with the second soft-output decoding 
means in the final stage to rearrange data of (k+1) bits of a soft-input input so that a 
bit array of data of (k+1) bits rearranged by the first interleaving means is returned to 
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a bit array of data of (k+1) bits coded by the first coding means; a third soft-output 
decoding means provided corresponding to the first coding means and serially 
concatenated with the second deinterleaving means to carry out soft-output decoding 
using priori probability information with respect to code bits of (k+1) bits which are 
a soft-input output from the second deinterleaving means, and priori probability 
information with respect to information bits of (k+1) bits which are a soft-input input; 
and a fourth interleaving means for interleaving order of bits constituting data 
comprising a bit series of (k+1) pieces of a soft-input output from the third soft-output 
decoding means on the basis of the same exchange position information as that of the 
first interleaving means. 

Further, the decoding method according to the present invention for achieving 
the aforementioned object is a decoding method for carrying out decoding of codes 
subjected to serially concatenated code modulation by a coding method comprising: 
a first coding step for carrying out coding whose code rate is k/(k+l) with respect to 
data of k-bit input; a first interleaving step for interleaving order of bits constituting 
data comprising a bit series of (k+1) pieces coded by the first coding step; a coding 
processing step for carrying out at least one or more processes including a second 
coding step for carrying out coding whose code rate is 1 with respect to data of (k+ 1 ) 
bit input; and a second interleaving step for interleaving order of bits constituting a bit 
series of (k+1) pieces coded by the second coding step; a third coding step for 
carrying out coding whose code rate is 1 with respect to data of (k+1) bit processed 
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by the coding processing step and input ; and a mapping step for mapping data of 
(k+1 ) bits coded by the third coding step to a transmission symbol of a predetemiined 
modulation; the decoding method comprising: a first soft-output decoding step 
provided corresponding to the third coding step to carry out soft-output decoding using 
a reception word which is a soft-input input, and priori probability information with 
respect to information bits of (k+1) bits which is a soft-input input; a decoding 
processing step for carrying out at least one or more processes including a first 
deinterleaving step, a second soft-output decoding step and a third interleaving step 
with respect to data of (k+1) bits of a soft-input input; a second deinterleaving step for 
rearranging data of (k+1) bits of a soft-input processed by the decoding processing 
step input so that a bit array of data of (k+1) bits rearranged by the first interleaving 
step is returned to a bit array of data of (k+1) bits coded by the first coding step; a 
third soft-output decoding step provided corresponding to the first coding step to carry 
out soft-output decoding using priori probability information with respect to code bits 
of (k+ 1 ) bits which are a soft-input rearranged by said second deinterleaving step, and 
priori probability information with respect to information bits of (k+1) bits which are 
a soft-input input; and a fourth interleaving step for interleaving order of bits 
constituting data comprising a bit series of (k+1) pieces of a soft-input output 
produced by said third soft-output decoding step on the basis of the same exchange 
position information as that of the first interleaving step; the first deinterleaving step 
rearranging data of (k+1) bits of a soft-input input so that a bit array of data of (k+1) 
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bits rearranged by the second interleaving step is returned to a bit array of data of 
(k+1) bits coded by the second coding step; the second soft-output decoding step 
being provided corresponding to the respective ones of at least one or more second 
coding steps to carry out soft-output decoding using priori probability information with 
respect to code bits of (k+1) bits which are a soft-input output rearranged by the first 
deinterleaving step, and priori probability infonnation with respect to information bits 
of (k+1) bits which are a soft-input input; and the third interleaving step for 
interleaving order of bits constituting data comprising a bit series of (k+1) pieces of 
a soft-input produced by the respective ones of at least one or more second soft-output 
decoding steps on the basis of the same exchange position information as that of the 
second interleaving step. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram for explaining the constitution of a communication 

model. 

FIG. 2 is a block diagram for explaining the constitution of a conventional 
coding apparatus. 

FIG. 3 is a block diagram for explaining the constitution of a conventional 
decoding apparatus. 

FIG. 4 is a block diagram for explaining the constitution of a communication 
model to which is applied a data transmit-receive system showing as the form of an 
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embodiment according to the present invention. 

FIG. 5 is a block diagram for explaining the constitution of a coding apparatus 
in the data transmit-receive system. 

FIG. 6 is a block diagram for explaining the constitution of a convolutional 
coder for carrying out coding of exterinsic codes provided on a coding apparatus. 

FIG. 7 is a block diagram for explaining the constitution of an interleaver 
provided on a coding apparatus. 

FIG. 8 is a block diagram for explaining the constitution of a convolutional 
coder for carrying out coding of middle codes provided on a coding apparatus. 

FIG. 9 is a block diagram for explaining the constitution of an interleaver 
provided on a coding apparatus, which is an interleaver different from that shown in 
FIG. 4. 

FIG. 10 is a block diagram for explaining the constitution of a convolutional 
coder for carrying out coding of internal codes provided on a coding apparatus. 

FIG. 1 1 is a block diagram for explaining the constitution of a decoding 
apparatus in the data transmit-receive system. 

FIG. 12 is a block diagram for explaining the constitution of a soft-output 
decoding circuit for carrying out soft-output decoding of internal codes provided on 
a decoding apparatus. 

FIG. 13 is a block diagram for explaining the constitution of a soft-output 
decoding circuit for carrying out soft-output decoding of middle codes provided on a 
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decoding apparatus. 

FIG. 14 is a block diagram for explaining the constitution of a soft-output 
decoding circuit for carrying out soft-output decoding of exterinsic codes provided on 
a decoding apparatus. 

FIG. 15 is a block diagram for explaining the constitution of a computer 
apparatus. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments to which is applied the present invention will be 
described in detail with reference to the accompanying drawings. 

This embodiment is concerned with a data transmit-receive system applied to 
a communication model in which as shown in FIG. 4, digital information is coded by 
a coding apparatus 1 provided on a communication apparatus not shown, output of 
which is input into a receiving apparatus not shown through a memoryless channel 2 
with noises, and the output is decoded by a decoding apparatus 3 provided on the 
receiving apparatus. 

In the data transmit-receive system, the coding apparatus 1 carries out coding 
according to a serial concatenated trellis code modulation, which is hereinafter 
referred to as SCTCM, system, in which at least three or more coders are serially 
concatenated through interleavers. Further, the decoding apparatus 3 carries out 
decoding of codes code according to the SCTCM system by the coding apparatus 1 , 
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in which at least three or more decoding circuits depending on the constitution of the 
coding apparatus 1 are serially concatenated. 

As shown in FIG. 5, the coding apparatus 1 comprises three convolutional 
coders 10, 30 and 50 for carrying out convolutional operation which are a first coding 
means, a second coding means, a third coding means; two interleavers 20 and 40 
which are a first interleaving means and a second interleaving means for rearranging 
order of data input; and a multi-value modulation mapping circuit 60 which is a 
mapping means for carrying out mapping of a signal point on the basis of a 
predetermined modulation system. The coding apparatus carries out serial 
concatenated convolutional operation whose code rate is "2/3" with respect to input 
data Dl of 2 bits input to convert the former into code data D6 of 3 bits, which is 
subjected, for example, to mapping to a transmission symbol of a 8 PSK ( 8-phase 
Shift Keying) modulation system to output it as one code transmission symbol D7 of 
3 bits. 

The convolutional coder 10 comprises three exclusive-OR circuits 11, 13, and 
15, and two shift registers 12 and 14, as shown in FIG. 6. 

The exclusive logic sum circuits 1 1 carries out exclusive-OR operation using 
input data Dlj and Dl 2 of 2 bits to supply the operation result to the shift register 12. 

The shift register 12 continues to supply data of 1 bit being held to the 
exclusive-OR circuit 13. The shift register 12 newly holds data of 1 bit supplied from 
the exclusive-OR circuit 1 1 by being synchronized with a clock, and newly supplies 
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the data to the exclusive-OR circuit 13. 

The exclusive-OR circuit 13 uses data supplied from the shift register 12 and 
input data Dlj of 1 bit out of input data Dl of 2 bits to carry out exclusive-OR 
operation to supply the operation result to the shift register 14. 

The shift register 14 continues to supply data of 1 bit being held to the 
exclusive-OR circuit 15. The shift register 14 newly holds data of 1 bit supplied from 
the exclusive-OR circuit 13 by being synchronized with a clock, and newly supplies 
the data to the exclusive-OR circuit 15. 

The exclusive-OR circuit 15 uses data supplied from the shift register 14 and 
input data Dl] and Dl 2 to carry out exclusive-OR operation to output the operation 
result to the interleaver 20 in the later stage as code data D2 3 of 1 bit out of code dat 
D2 of 3 bits. 

The convolutional coder 10, when input data Dlj and Dl 2 of 2 bits are input, 
carries out convolutional operation with respect to the Dlj and Dl 2 to output the 
operation result to the interleaver 20 in the later stage as code data D 1 u D 1 2 and D2 3 
of 3 bits. That is, the convolutional coder 10 carries out convolutional operation whose 
code rate is "2/3" as coding of a first code (hereinafter referred to as an exterinsic 
code) to output code data D2 to the interleaver 20 in the later stage. 

As shown in FIG. 7, the interleaver 20 comprises an input data holding memory 
21 for holding data input, a data exchange circuit 22 for carrying out rearrangement 
(exchange) of data input, an exchange data ROM (Read Only Memory) for storing 
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exchange position information of data, and an output data holding memory 24 for 
holding data output. 

The input data holding memory 21 holds code data D2 comprising three bit 
series output from the convolutional coder 10 to supply the code data D2 to the data 
exchange circuit 22 at a predetermined timing. 

The data exchange circuit 22 rearranges order of the code data D2 supplied 
from the input data holding memory 21 on the basis of the exchange position 
information of data being stored in the exchange data ROM 23. The data exchange 
circuit 22 supplies the rearranged data to the output data holding memory 24. 

The exchange ROM 23 stores exchange position information of data decided, 
for example, on the basis of random number generated. The interleaver 20 is 
constituted as a random interleaver for carrying out interleave of data on the basis of 
the exchange position information. The exchange position information stored in the 
exchange data ROM is read by the data exchange circuit 22 as occasion calls. 

The output data holding memory 24 holds data supplied from the data exchange 
circuit 22, and outputs these data to the convolutional coder 30 at a predeteniiined 
tuning as interleave data D3 comprising three bit series. 

The interleaver 20 applies interleave to the code data D2 output from the 
convolutional coder 10 to output it to the convolutional coder 30 in the later stage. 

More specifically, the input data holding memory 21 sequentially inputs and 
holds the respective ones of code data D2 comprising three bit series output from the 
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convolutional coder 1. The input data holding memory 21 sequentially holds, for 
example, bits constituting respective ones of code data D2 at a predetermined timing, 
and supplies the data being held to the data exchange circuit 22 at a timing produced 
by three bit series comprising N bits (N is suitable natural number). 

Continuously, the data exchange circuit 22 rearranges order of bits of N x 3 
pieces constituting three bit series supplied from the input holding memory 21 on the 
basis of exchange information stored in the exchange data ROM 23. The data 
exchange circuit 22 supplies three new bit series obtained by the rearrangement to the 
output data holding memory 24. 

The output data holding memory 24 holds bits constituting three bit series 
supplied from the data exchange circuit 22, and outputs the data held to the 
convolutional coder 30 in the later stage at a predetermined timing, as the interleave 
data D3. 

As described above, the interleaver 20 inputs the code data D2 comprising three 
bit series output from the convolutional coder 10, and rearrange order of bits 
constituting the code data D2 on the basis of exchange position information pre-stored 
to produce the interleave data D3. 

As shown in FIG. 8, the convolutional coder 30 comprises an exclusive-OR 
circuit 3 1 and a shift register 32. 

The exclusive-OR circuit 3 1 carries out exclusive-OR operation using interleave 
data D3 j , D3 2 and D3 3 of 3 bits to output the operation result to an interleaver 40 in 
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the later stage as code data D4 3 of 1 bit out of code data D4 of 3 bits and supply them 
to the shift register 32. 

The shift register 3 continues to supply data of 1 bit being held to the exclusive- 
OR circuit 31. The shift register 32 newly holds data of 1 bit supplied from the 
exclusive-OR circuit 3 1 by being synchronized with a clock, and newly supplies the 
data to the exclusive-OR circuit 31. 

As described above, the convolutional coder 30, when the interleave data D3 U 
D3 2 and D3 3 of 3 bits are input, carries out recursive system convolutional operation 
with respect to these interleave data D3 l5 D3 2 and D3 3 to output the operation result 
to the interleaver 40 in the later stage as code data D3 1? D3 2 and D3 3 of 3 bits. That 
is, the convolutional coder 30 carries out recursive system convolutional operation 
whose code rate is "3/3 = 1" as coding of a second code (hereinafter referred to as a 
middle code) to output code data D4 to the interleaver 40. 

The interleaver 40 comprises the constitution similar to that of the interleaver 
20. That is, as shown in FIG. 9, the interleaver 40 comprises an input data holding 
memory 4 1 for holding data input, a data exchange circuit for rearranging order of data 
input, an exchange data ROM 43 for storing exchange position information of data, 
and an output data holding memory 44 for holding data output. 

The interleaver 40 as described above inputs code dataD4 comprising three bit 
series output from the convolutional coder 30, and rearranges order of bits constituting 
the code data D4 on the basis of exchange position information pre-stored to produce 
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interleave data D5. The interleaver 40 outputs the produced interleave data D5 to a 
convolutional coder 50 in the later stage. 

It is noted that exchange position infonnation of data stored in an exchange 
data ROM 43 in the interleaver 40 may be the same as or different from exchange 
position infonnation of data stored in the exchange data ROM 23 in the interleaver 20. 

A convolutional coder 50 comprises the constitution similar to that of the 
convolutional coder 30. That is, the convolutional coder 50 comprises an exclusive-OR 
circuit 51 and a shift register 52, as shown in FIG. 10. 

The convolutional coder 50 as described above, when the interleave data D5 U 
D5 2 and D5 3 of 3 bits are input, carries out recursive system convolutional operation 
with respect to these interleave data D5j, D5 2 and D5 3 to output the operation result 
to a multi-value modulation mapping circuit 60 in the later stage as code data D6 l5 
D6 2 and D6 3 of 3 bits. That is, the convolutional coder 50 carries out recursive 
systematic convolutional operation whose code rate is "3/3 = 1" as coding of a third 
code (hereinafter referred to as an internal code) to output code data D6 to the multi- 
value modulation mapping circuit 60 in the later stage. 

The multi-value modulation mapping circuit 60 causes the code data to 
synchronize with a clock to map to a transmission symbol of an 8PSK modulation 
system, for example. That is, the multi-value modulation mapping circuit 60 maps the 
code data D6 of 3 bits output from the convolutional coder 50 to produce one code 
transmission symbol D7. The multi-value modulation mapping circuit 60 outputs the 
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produced code transmission symbol D7 outside. 

The coding apparatus 1 as described above carries out convolutional operation 
whose code rate is "2/3" as coding of an outer code by the convolutional coder 10, 
carries out convolutional operation whose code rate is "1" as coding of a middle code 
by the convolutional coder 30, and carries out convolutional operation whose code 
rate is "1" as coding of an inner code by the convolutional coder 50 whereby the serial 
concatenated convolutional operation whose code rate is "(2/3) x 1 x 1 = 2/3" can be 
carried out as a whole. Data code and modulated by the coding apparatus are output 
to the receiving apparatus through the memoryless channel 2. 

On the other hand, the decoding apparatus 3 comprises, as shown in FIG. 1 1, 
three soft-output decoding circuits 70, 100 and 130 which are a first soft-output 
decoding means, a second soft-output decoding means, and a third soft-output 
decoding means for carrying out soft-output decoding, two deinterleavers 80 and 110 
which are a first deinterleaving means and a second deinterleaving means for returning 
order of data input to the original, two interleavers 90 and 120 which are a third 
interleaving means and a fourth interleaving means for rearranging order of data input, 
and a binary circuit 140 which is a binary means for forming data input into a form of 
a binary. The decoding apparatus 3 takes an analog value due to the influence of noises 
generated on the memoryless channel 2 and presumes input data Dl in the coding 
apparatus 1 from a reception word D8 to be a soft-input to output it as decode data 
D18. 
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The soft-output decoding circuit 70 is provided corresponding to the 
convolutional coder 50 in the coding apparatus 1 . The soft-output decoding circuit 70 
comprises, as shown in FIG. 12, a MAP decoder 71 for carrying out a maximum a 
posteriori probability, which is hereinafter referred to as MAP, decoding on the basis 
of a so-called BCJR (Bahl, Cocke, Jelinek and Raviv) algorithm, and three 
differentiators 72, 73 and 74. 

The MAP decoder 71 inputs a reception word D8 which is a soft-output, and 
priori probability information D9 l5 D9 2 and D9 3 with respect to information bit of 3 
bits which are a soft-input supplied from the interleaver 90, and carries out MAP 
decoding based on the BCJR algorithm to produce posteriori probability information 
D20 l5 D20 2 and D20 3 with respect to information bit of 3 bits on the basis of the 
reception word D8. The MAP decoder 7 1 supplies the produced posteriori probability 
information 020^0 the differentiator 72, supplies the produced posteriori probability 
information D20 2 to the differentiator 73, and supplies the produced posteriori 
probability information D20 3 to the differentiator 74. 

The differentiator 72 obtains a differential value between the produced 
posteriori probability information D20 1 and the priori probability information D9j 
and outputs the differential value to the deinterleaver 80 as a soft-output, as the 
extrinsic information DlOj of 1 bit out of the extrinsic information D10 with respect 
to information bit of 3 bits obtained according to the constraint condition of codes. 

The differentiator 73 obtains a differential value between the posteriori 
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probability infonnation D20 2 to be a soft-output and the priori probability information 
D20 2 , and outputs the differential value to the deinterleaver 80 in the later stage as 
a soft-output, as the extrinsic infonnation D20 2 of 1 bit out of the extrinsic 
information D10 with respect to information bit of 3 bits. 

The differentiator 74 obtains a differential value between the posteriori 

probability infonnation D20 3 to be a soft-output and the priori probability infonnation 
D20 3 and outputs the differential value to the deinterleaver 80 in the later stage as a 
soft-output, as the extrinsic infonnation D20 3 of 1 bit out of the extrinsic infonnation 
D10 with respect to information bit of 3 bits 

The soft-output decoding circuit 70 as described above inputs the reception 

word D8 of a soft-input received by the receiving apparatus, inputs the priori 
probability infonnation D9 with respect to infonnation bit of a soft-input supplied 
from the interleaver 90, and carries out MAP decoding based on the BCJR algorithm 
using these reception word D8 and the priori probability infonnation D9 and carries 
out soft-output decoding of inner codes. The soft-output decoding circuit 70 produces 
the extrinsic infonnation D 10 obtained according to the constraint condition of codes, 
and outputs extrinsic infonnation D 10 to the deinterleaver 80 in the latter stage as a 
soft-output. 

Specifically explaining, let u be the information bit, c the code bit, and y the 
reception word D8, then the soft-output decoding circuit 70 causes priori probability 
information D9 (L(u)) expressed in the following Equation (1) to input into the MAP 
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decoder 71 along with the reception word D8 (y): 


L(u) = log 


P{u = 1) 
P(u = 0) 


...(1) 


That is, the soft-output decoding circuit 70 causes the reception word D8 (y) 
and priori probability information D9 (L(u)) free from the constraint condition of 
codes expressed by the natural logarithm which is the ratio between the probability 
P(u=l) whose information bit u is "1" and the probability P(u=0) whose infonnation 
bit u is "0" to input into the MAP decoder 71. 

Continuously, the soft-output decoding circuit 70 carries out MAP decoding 
on the basis of BCJR algorithm by the MAP decoder 71 to produce posteriori 
probability information D20 (L*(u)) expressed by the following Equation (2): 


That is, the soft-output decoding circuit 70 produces posteriori probability 
information D20 (L*(u)) on the basis of the constraint condition of codes expressed 
by the natural logarithm which is the ratio between the probability P (u=l | y) whose 
information bit u is "1" when received the reception word D8 (y) and the probability 



... (2) 
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P (u=0 1 y) whose information bit u is "0" when received the reception word D8 (y). 
The posteriori probability information D20 (L*(u)) is also called the log likelihood 
ratio, and here, it shows the likelihood of the information bit u when received the 
reception word D8 (y). 

The soft-output decoding circuit 70 obtains extrinsic information D 10 (Le(u)) 
which is a differential value between the posteriori probability information D20 
(L*(u)) and the priori probability D9 (L(u)), as expressed by the following Equation 
(3) by the differentiators 72, 73 and 74. 

L e (u)= L*(u)- L{u) 

- (3) 

The soft-output decoding circuit 70 produces the extrinsic information D10 as 
in the manner as described above, and outputs the extrinsic information D10 to the 
deinterleaver 80 in the later stage as a soft-output. The extrinsic information D10 
corresponds to the interleave data D5 interleaved by the interleaver 40 in the coding 
apparatus 1. 

The deinterleaver 80 applies the interleave to the exterinsic information D10 of 
a soft-input output from the soft-output decoding circuit 70 so that a bit array of the 
interleave data D5 interleaved by the interleaver 40 is returned to a bit array of the 
original code data D4. The deinterleaver 80 outputs the data obtained by being 
interleaved as priori probability information Dl 1 with respect to the code bit in the 
soft-output decoding circuit 100 in the latter stage. 
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The interleaver 90 applies the interleave based on the same exchange position 
information as the interleaver 40 in the coding apparatus 1 to the exttrinsic information 
D14 with respect to the code bit which is a soft-output output from the soft-output 
decoding circuit 100. The interleaver 90 outputs the data obtained by being interleaved 
as the priori probability infonnation D9 with respect to the signal bit in the soft-output 
decoding circuit 70. 

A soft-output decoding circuit 100 is provided corresponding to the 
convolutional decoder 30 in the coding apparatus 1. The soft-output decoding circuit 
100 comprises, as shown in FIG. 13, a MAP decoder 101 for carrying out MAP 
decoding based on the BCJR algorithm described above, and six differentiators 102, 
103, 104, 105, 106 and 107. 

A MAP decoder 101 inputs priori probability information Dl l l5 Dl 1 2 and 
Dll 3 with respect to the code bit of 3 bits which is a soft-output output from the 
deinterleaver 80, and posterori probability information D12 l5 D12 2 andD12 3 with 
respect to the information bit of 3 bits which is a soft-input supplied from the 
interleaver 120, and carries out MAP decoding based on the BCJR algorithm to 
produce posterori probability infonnation D21 l5 D21 2 and D21 3 with respect to the 
information bit of 3 bits and produce posterori probability information D22 l5 D22 2 
and D22 3 with respect to the infonnation bit of 3 bits. The MAP 101 supplies the 
produced posterori probability infonnation 021^0 the differentiator 102, supplies 
the produced posterori probability infonnation D2 2 to the differentiator 103, and 
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supplies the produced posterori probability information D21 3 to the differentiator 
104. Further, The MAP 101 supplies the produced posterori probability information 
D22j to the differentiator 105, supplies the produced posterori probability 
information D22 2 to the differentiator 105, and supplies the produced posterori 
probability information D22 3 to the differentiator 106. 

The differentiator 102 obtains a differential value between the posterori 
probability information D21j to be a soft-input and the priori probability information 
D12i to be a soft-input to output the differential value to the deinterleaver 1 10 in the 
later stage as a soft-output, as the extrinsic information D13j of 1 bit out of the 
extrinsic information D 13 with respect to information bit of 3 bits obtained according 
to the constraint condition of codes. 

The differentiator 103 obtains a differential value between the posterori 
probability information D2 1 2 to be a soft-input and the priori probability information 
D12 2 to be a soft-input to output the differential value to the deinterleaver 1 10 in the 
later stage as a soft-output, as the extrinsic information D13 2 of 1 bit out of the 
extrinsic information D13 with respect to information bit of 3 bits. 

The differentiator 104 obtains a differential value between the posterori 
probability information D21 3 to be a soft-input and the priori probability information 
D12 3 to be a soft-input to output the differential value to the deinterleaver 1 10 in the 
later stage as a soft-output, as the extrinsic information D13 3 of 1 bit out of the 
extrinsic information D13 with respect to information bit of 3 bits. 
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The differentiator 105 obtains a differential value between the posterori 
prob ability infonnation D22 1 to be a soft-input and the priori probability information 
D 1 1 1 to be a soft-input to output the differential value to the interleaver 90 as a soft- 
output, as the extrinsic infonnation Dl4 l of 1 bit out of the extrinsic infonnation 
D14 with respect to infonnation bit of 3 bits. 

The differentiator 106 obtains a differential value between the posterori 
probability information D22 2 to be a soft-input and the priori probability infonnation 
D 1 1 2 to be a soft-input to output the differential value to the interleaver 90 as a soft- 
output, as the extrinic infonnation D 14 2 of 1 bit out of the exttrinsic information D 14 
with respect to infonnation bit of 3 bits. 

The differentiator 107 obtains a differential value between the posterori 
probability infonnation D22 3 to be a soft-input and the priori probability infonnation 
Dl 1 3 to be a soft-input to output the differential value to the interleaver 90 as a soft- 
output, as the extrinsic information D 14 3 of 1 bit out of the extrinsic infonnation D 14 
with respect to infonnation bit of 3 bits. 

The soft-output decoding circuit 100 as described above inputs the priori 
probability information D 1 1 with respcet to the code bit of a soft-input output from the 
deinterleaver 80, and inputs the priori probability infonnation D 12 with respect to the 
infonnation bit of a soft-input supplied from the interleaver 120, and uses these priori 
probability information D 1 1 and D 1 2 to carry out MAP decoding based on the BCJR 
algorithm and carry out soft-output decoding of middle codes. The soft-output 
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decoding circuit 100 produces the extrinsic information D13 and D14 obtained 
according to the constraint condition of codes, and outputs the extrinsic information 
D13 to the deinterleaver 110 in the later stage as a soft-output, and outputs the 
extrinsic information D14 to the interleaver 90 as a soft-output. 

Specifically explaining, let u be the information bit and c the code bit, then the 
soft-output decoding circuit 100 causes priori probability information D12 (L(u)) 
expressed in the following Equation (4) and priori probability information Dl 1 (L(c)) 
expressed in the following Equation (5) to input into the MAP decoder 101: 


That is, the soft-output decoding circuit 100 causes the priori probability 
information D 12 (L(u)) on the basis of the constraint condition of codes expressed by 
the natural logarithm which is the ratio between the probability P(u=l) whose 
information bit u is "1" and the probability P (u=0) whose information bit u is "0" , 
and the priori probability information Dll (L(c)) on the basis of the constraint 
condition of codes expressed by the natural logarithm which is the ratio between the 


L(u) = log 


P(u= 0) 


... (4) 


L(c) = log 


P(c=0) 


...(5) 
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probability P(c=l) whose code bit c is "1" and the probability P (c=0) whose code bit 
c is "0" to input into the MAP decoder 101. 

Continuously, the soft-output decoding circuit 100 carries out MAP decoding 
on the basis of BCJR algorithm by the MAP decoder 101 to produce posteriori 
probability information D21 (L*(u)) expressed by the following Equation (6) and 
posteriori probability information D22 (L*(c)) expressed by the following Equation 
(7): 

... (6) 
... (7) 

That is, the soft-output decoding circuit 100 produces posteriori probability 
information D21 (L*(u)) on the basis of the constraint condition of codes expressed 
by the natural logarithm which is the ratio between the probability P (u=l) whose 
information bit u is "1" and the posteriori probability P (u=0) whose information bit 
u is "0", and posterior probability information D22 (L*(c)) on the basis of the 
constraint condition of codes expressed by the natural logarithm which is the ratio 
between the probability P (C=l) whose code bit c is "1" and the probability P(c=0) 
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whose code bit c is "0". It is noted that the constraint conditions of codes described 
on the right side of the Equations (6) and (7) are omitted here. The posteriori 
probability information D21 (L*(u)) and the posteriori probability information D22 
(L*(c)) are also called the log likelihood ratio, and here, it shows the likelihood of the 
information bit u and the likelihood of the code bit c. 

The soft-output decoding circuit 100 obtains extrinsic information D13 (Le(u)) 
which is a differential value between the posteriori probability information D21 
(L*(u)) and the priori probability D 12 (L(u)), as expressed by the following Equation 
(8) by the differentiators 102, 103 and 104; and obtains extrinsic information D14 
(Le(c)) which is a differential value between the posteriori probability information 
D22 (L*(c)) and the priori probability Dll (L(c)), as expressed by the following 
Equation (9) by the differentiators 105, 106 and 107. 

4(w)= L*(u)- L(u) 

... (8) 

L e {c) = L*(c)-L(c) 

... (9) 

The soft-output decoding circuit 100 produces the extrinsic information D13 
and D14 in the manner as described above, outputs the extrinsic information D13 to 
the deinterleaver 110 in the later stage as a soft-output and outputs the extrinsic 
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information D14 to the deinterleaver 90 as a soft-output. The extrinsic information 
D13 corresponds to the interleave data D3 interleaved by the interleaver 20. 

The deinterleaver 110 applies the deinterleave to the extrinsic information D 1 3 
of a soft-input output from the soft-output decoding circuit 100 so that a bit array of 
the interleave data D3 interleaved by the interleaver 20 is returned to a bit array of the 
original code data D2. The deinterleaver 100 outputs the data obtained by being 
interleaved as priori probability information D15 with respect to the code bit in the 
soft-output decoding circuit 130 in the latter stage. 

The interleaver 120 applies the interleave based on the same exchange position 
information as the interleaver 20 in the coding apparatus 1 to the extrinsic information 
D18 with respect to the code bit which is a soft-output output from the soft-output 
decoding circuit 130. The interleaver 120 outputs the data obtained by being 
mterleaved as the priori probability information D12 with respect to the information 
bit in the soft-output decoding circuit 100. 

A soft-output decoding circuit 130 is provided corresponding to the 
convolutional decoder 10 in the coding apparatus 1. The soft-output decoding circuit 
130 comprises, as shown in FIG. 14, a MAP decoder 131 for carrying out MAP 
decoding based on the BCJR algorithm described above, and five differentiators 132, 
133, 134, 135, and 136. 

A MAP decoder 131 inputs priori probability information D15 1? D15 2 and 
D15 3 with respect to the code bit of 3 bits which is a soft-output output from the 
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deinterleaver 110, and posterori probability information D16 x and D16 2 with respect 
to the information bit of 2 bits whose value is "0", and carries out MAP decoding 
based on the BCJR algorithm to produce posterori probability information D21 l5 
D21 2 and D21 3 with respect to the information bit of 3 bits and produce posterori 
probability information D23 1 and D23 2 with respect to the information bit of 3 bits 
and produce posterori probability information D24 u D24 2 and D24 3 with respect to 
the code bit of 3 bits. The MAP 131 supplies the produced posterori probability 
information D23 l to the differentiator 132, and supplies the produced posterori 
probability information D23 2 to the differentiator 133. Further, the MAP 131 
supplies the produced posterori probability information D24 1 to the differentiator 
134, supplies the produced posterori probability information D24 2 to the 
differentiator 135, and supplies the produced posterori probability information D24 3 
to the differentiator 136. 

The differentiator 132 outputs a differential value between the posterori 
probability information D23j to be a soft-input and the priori probability information 
Dl 6j whose value is "0", that is, the priori probability information D23j to the binary 
circuit 140 as a soft-output, as the extrinsic information Dl7 i of 1 bit out of the 
extrinsic infonnation D 17 with respect to information bit of 2 bits obtained according 
to the constraint condition of codes. 

The differentiator 133 outputs a differential value between the posterori 
probability infonnation D23 2 to be a soft-input and the priori probability infonnation 
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D16 2 whose value is "0", that is, the posterori probability information D23 2 to the 
binary circuit 140 in the later stage as a soft-output, as the extrinsic information D 17 2 
of 1 bit out of the extrinsic information D17 with respect to information bit of 2 bits. 

The differentiator 134 obtains a differential value between the posterori 
probability information D24 t to be a soft-input and the priori probability information 
D 1 5 j to be a soft-input to output the differential value to the interleaver 1 20 as a soft- 
output, as the extrinsic information Dl S l of 1 bit out of the extrinsic information D 1 8 
with respect to code bit of 3 bits. 

The differentiator 135 obtains a differential value between the posterori 
probability information D24 2 to be a soft-input and the priori probability information 
D15 2 to be a soft-input to output the differential value to the interleaver 120 as a 
soft-output, as the extrinsic information D18 2 of 1 bit out of the extrinsic information 
D18 with respect to the code bit of 3 bits. 

The differentiator 136 obtains a differential value between the posterori 
probability information D24 3 to be a soft-input and the priori probability information 
D15 3 to be a soft-input to output the differential value to the interleaver 120 as the 
extrinsic information D 1 8 3 of 1 bit out of the extrinsic information D 1 8 with respect 
to the information bit of 3 bits. 

The soft-output decoding circuit 130 as described above inputs the priori 
probability information D 1 5 with respect to the code bit of a soft-input output from the 
deinterleaver 110, and inputs the priori probability information D 1 6 with respect to the 
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information bit whose value is "1", and uses these priori probability information D 15 
and Dl 6 to carry out MAP decoding based on the BCJR algorithm and carry out soft- 
output decoding of outer codes. The soft-output decoding circuit 130 produces the 
extrinsic information D17 and D18 obtained according to the constraint condition of 
codes, and outputs the extrinsic information D17 to the binary circuit 140 in the later 
stage as a soft-output, and outputs the extrinsic information D 1 8 to the interleaver 120 
as a soft-output. 

Specifically explaining, let u be the information bit and c the code bit, as 
described above, then the soft-output decoding circuit 130 causes priori probability 
I; information D16 (L(u)) expressed in the above Equation (4) and priori probability 
p "; information D15 (L(c)) expressed in the above Equation (5) to input into the MAP 
.I decoder 131. It is noted here that priori probability information D16 (L(u)) is "0" 
because the probability whether the information bit u is "0" or "1" is Vi. 

Continuously, the soft-output decoding circuit 130 carries out MAP decoding 
on the basis of BCJR algorithm by the MAP decoder 131 to produce posteriori 
probability information D23 (L*(u)) expressed by the above Equation (6) and 
posteriori probability information D22 (L*(c)) expressed by the above Equation (7). 
That is, the soft-output decoding circuit 130 produces the posteriori probability 
information D23 (L*(u)) on the basis of the constraint condition of codes expressed 
by the natural logarithm of the ratio between the probability P (u=l) whose 
information bit u is " 1 " and the probability P (u=0) whose information bit u is "0" and 
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the posteriori probability information D24 (L*(c)) on the basis of the constraint 
condition of codes expressed by the natural logarithm of the ratio between the 
probability P (c=l) whose code bit c is "1" and the probability P (c=0) whose code bit 
c is "0". It is noted that these posteriori probability information D23 (L*(u)) and 
posteriori probability information D24 (L*(c)) are also called the log likelihood ratio, 
and here, it shows the likelihood of the information bit u and the likelihood of the code 
bit c. 

The soft-output decoding circuit 130 obtains extrinsic information D 17 (Le(u)) 
which is a differential value between the posteriori probability information D23 
(L*(u)) and the priori probability D16 (L(u)), as expressed by the above Equation (8) 
by the differentiators 132 and 133; and obtains extrinsic information D18 (Le(c)) 
which is a differential value between the posteriori probability information D24 
(L*(c)) and the priori probability D15 (L(c)), as expressed by the above Equation (9) 
by the differentiators 134, 135, and 136. 

The soft-output decoding circuit 130 produces the extrinsic information D17 
and D18 in the manner as described above, outputs the extrinsic information D17 to 
the binary circuit 140 in the later stage as a soft-output and outputs the extrinsicl 
information D18 to the deinterleaver 120 as a soft-output. 

The soft-output decoding circuit 130 need not always be provided with the 
differentiators 132 and 133 since the priori probability information D16 with respect 
to the information bit is "0". 
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The binary circuit 1 40 forms extrinsic information D 1 7 of soft-output produced 
by the soft-output decoding circuit 130, that is, extrinsic information D17 supplied 
from the soft-output decoding circuit 130 in a form of binary on the basis of the 
posterori probability information D23 to output it as decode data D 1 8 of hard-output. 

The decoding apparatus 3 as described above is provided with soft-output 
decoding circuits 70, 100 and 130 corresponding to the convolutional coders 50, 30 
and 10, respectively, in the coding apparatus 1 whereby codes of high decoding 
complicatedness can be decomposed into elements of small complicatedness, and the 
characteristics can be successively enhanced by mutual action between the soft-output 
decoding circuits 70, 100 and 130. The decoding apparatus 3, when inputting the 
reception word D8, carries out decoding operation of the soft-output decoding circuits 
70 to 130 iteratively by the predetermined number of times, for example, such as 
several times and scores of times, and outputs decode data D19 on the basis of the 
extrinsic information D17 of soft-output obtained as a result of the predetennined 
number of times of the decoding operation, that is, on the basis of the posterori 
probability information D23. 

As explained above, in the data transmit-receive system constituted using the 
coding apparatus 1 and the decoding apparatus 3, the decoding apparatus 3 has the 
convolutional coders 10, 30 and 50 serially concatenated to carry out convolutional 
operation whose code rate is expressed by "k/(k+l)" (k is arbitrary natural number 
more than 2) as coding of outer codes, after which carries out convolutional operation 
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whose code rate is "1" as coding of middle codes and inner codes, whereby the whole 
code rate can be maintained at a high value, "k/(k+l )". Further, the coding apparatus 
1 carries out the convolutional operation iteratively to carry out coding of high 
performance under the high code rate. In the decoding apparatus 3, are provided to be 
concatenated with the soft-output decoding circuits 70, 100, and 130 each 
corresponding to the convolutional coders 50, 30 and 10 in the coding apparatus 1 
whereby decoding of high precision can be carried out. That is, the data transmit- 
receive system constituted using these coding apparatus 1 and decoding apparatus 3 
is to realize coding and decoding according to the SCTCM system with high 
performance to enable provision of high reliance for a user. 

The present invention is not limited to the above-described embodiments. For 
example, the convolutional coder for carrying out coding of middle codes in the coding 
apparatus need not be a single but two or more of them may be used. It is of course 
that as the whole coding apparatus, four or more convolutional coders may be 
provided. Needless to say, in this case, an interleaver is provided between a plurality 
of convolutional coders for carrying out coding of middle codes. 

Further, as the coding apparatus, those other than that carries out coding by the 
convolutional operation will suffice, and the present invention can be applied even if 
the convolutional coders shown in the above-described embodiments are replaced by 
coders other than the convolutional operation. 

While in the aforementioned embodiments, a description has been made of a 
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case in which coding whose code rate is "2/3" is carried out as coding of outer codes, 
and coding whose code rate is "1" is carried out as coding of middle codes and inner 
codes, it is noted that the present invention is not adherred thereto but the present 
invention may be also applied to the case in which coding is carried out at least once 
whose code rate is "1" or more, for example, such that code rate of outer codes is "2/4 
= Vi \ code rate of middle codes is "4/3", and code rate of inner codes is "1" , and the 
code rate is "k/(k+l) (=2/3)" as a whole. 

Further, while in the above-described embodiments, a description has been 
made applying the 8PSK modulation system as multi-value modulation, it is to be 
noted that the present invention can be also applied to other multi-value modulation 
systems such that, for example, the code rate in the coding apparatus is "3/4" as a 
whole, and mapping is made to a transmission symbol of a 16 QAM ( 16-quadrature 
amplitude modulation) modulation system. 

Further, while in the above-described embodiments, a description has been 
made of a soft-output decoding circuit in the decoding apparatus in which MAP 
decoding based on the BCJR logarithm is carried out, it is to be noted that the present 
invention can be also applied to other soft-output decodings, for example, such that 
decoding according to a so-called SOVA (Soft Output Viterbi Logarithm). 

Further, while in the above-described embodiments, a description has been 
made of a case where the coding apparatus and the decoding apparatus are applied to 
the transmission apparatus and the receiving apparatus in the data transmit-receive 
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system, the present invention can be also applied, for example, to a recording and or 
a reproducing apparatus for carrying out recording and or reproducing with respect 
to recording media such as a magnetic, optical or optical magnetic disk or the like such 
as a floppy disk, CD-ROM or MO (Magneto Optical). In this case, data coded by the 
coding apparatus are recorded in a recording medium equivalent to a memoryless 
channel, and decode and reproduced by the decoding apparatus. 

Furthermore, while in the above-described embodiments, a description has been 
made of a case in which both coding apparatus and decoding apparatus comprise an 
apparatus constituted of hardware, it is to be noted that both the coding apparatus and 
decoding apparatus can be realized as softwares capable of being executed in a 
computer apparatus, for example, such as a work station or a personal computer. This 
embodiment will be described hereinafter with reference to FIG. 15. 

A computer apparatus 150 comprises, as shown in FIG. 15, a CPU (Central 
Processing Unit) 15 1 for collectively controlling various parts, a ROM 152 exclusive 
use for reading for storing information including various programs, a RAM (Random 
Access Memory) 153 which functions as a work area, a HDD (Hard Disk Drive) 154 
for carrying out recording and/or reproducing of various programs, data and so on, a 
bus 155 for connecting these CPU 151, ROM 152, RAM 153, and HDD 154, an 
input/output interface 1 56 for carrying out inputting and outputting between the CPU 
151, ROM 1 52, RAM 1 53 , and HDD 1 54, and a display section 1 57, an input section 
153, a communication section 159, and a drive 160 which will be described later, a 
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display section 157 for displaying various information, an input section 158 for 
receiving user's operation, a communication section 159 for carrying out 
communication with the outside, and a drive 160 for carrying out recording and or 
reproducing of various information with respect to a detachable recording medium 
170. 

The CPU 151 is connected through the bus 155 to ROM 152, RAM 153, and 
HDD 154 to control these ROM 152, RAM 153, and HDD 154. The CPU 151 is 
further connected through the bus 1 55 to the input/output interface 1 56 to control the 
display section 257, the input section 158, the communication section 159, and the 
drive 160 connected to the input/output interface 156. The CPU 151 further executes 
various programs recorded in the recording medium 170 mounted on the ROM 151, 
ROM152, HDD154 or the drive 160. 

The ROM 152 stores information including various programs therein. 
Information stored in the ROM152 is read under the control of CPU 151. 

The RAM 153 functions as a work area when CPU 151 executes various 
programs to temporarily store various data under the control of CPU 151. 

The HDD 154 carries out recording and or reproducing of various programs, 
data and so on with respect to the hard disk under the control of CPU 151. 

The bus 155 transmits various data read out of ROM 152, RAM 153, and 
HDD 154 under the control of CPU 151, and transmits various data to be recorded in 
RAM 153, and HDD 154. 
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The input/output interface 156 has an interface for displaying various 
information in the display section 157 under the control of CPU 151, an interface for 
transmitting a control signal indicative of contents operated through the input section 
158 by a user to CPU 15 1, an interface for inputting and outputting data with respect 
to the outside through the communication section 159 under the control of CPU 151, 
and an interface for carrying out recording and or reproducing of various information 
with respect to the recording medium 170 mounted on the drive 160 to output data 
from CPU 151, ROM 152, RAM 153, and HDD 154 to the display section 157, the 
input section 158, the communication section 159 and the drive 160, or inputs data 
from the display section 157, the input section 158, the communication section 159 
and the drive 160 into CPU 151, ROM 152, RAM 153, and HDD 154. 

The display section 157 comprises, for example, LCD (Liquid Crystal Display), 
to display various information such as data recorded, for example, in the HDD 154 
under the control of CPU 151. 

The input section 158 receives, for example, operation of a keyboard or a mouse 
by a user to output a control signal indicative of contents of operation to CPU 151. 

The communication section 150 functions as an interface for carrying out, for 
example, communication with the outside by a network circuit, a satellite circuit or 
the like under the control of CPU 151. 

The drive 160 mounts or dismounts the recording medium 170 such as a 
magnetic, light or photo electro-magnetic disk, for example, such as a floppy disk, CD- 
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ROM or MO, and carries out recording and or reproducing of various information with 
respect to the recording medium 170 mounted under the control of CPU 151. 

The computer apparatus 1 50 realizes coding process in the above-described 
coding apparatus and or decoding process in the decoding apparatus 3 by CPU 151 
which executes programs. 

First, the coding process in the computer apparatus 150 will be described. The 
computer apparatus 150, when for example, auser carries out predetermined operation 
for executing a code program, supplies a control signal indicative of contents of 
operation to CPU 150 by th input section 158. In response thereto, the computer 
apparatus 150 loads a code program to RAM 153 to execute it, and outputs a code 
transmission symbol obtained by coding to the outside through the communication 
section 159, and displays the processed results or the like on the display section 157 
as necessary. 

As used herein, the code program is provided, for example, by the recording 
medium 170, and may be read directly from the recording medium 170 under the 
control of CPU 151, or one recorded in the hard disk once may be read. The code 
program may be stored in advance in ROM 152. Further, data subjected to coding is 
recorded in the hard disk here. This data corresponds to the aforementioned input data 
Dl. 

Concretely, the computer apparatus 150, when a code program is executed by 
CPU 150, reads the desired data stored in the hard disk under the control of CPU 151, 
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and carries out convolutional operation whose code rate is "2/3" as coding of outer 
codes with respect to the data to produce code data corresponding to the 
aforementioned code data D2. 

Continuously, the computer apparatus 150 applies interleave to the produced 
code data under the control of CPU 15 1 to produce interleave data corresponding to 
the aforementioned inerleave data D3. 

Continuously, the computer apparatus 150 carries out convolutional operation 
whose code rate is "3/3=1" as coding of middle codes with respect to the produced 
interleave data under the control of CPU 15 1 to produce code data corresponding to 
the aforementioned code data D4. 

Continuously, the computer apparatus 150 applies interleave to the produced 
code data under the control of CPU 151 to produce interleave data corresponding to 
the aforementioned inerleave data D5. 

Continuously, the computer apparatus 150 carries out convolutional operation 
whose code rate is "3/3=1" as coding of inner codes with respect to the produced 
interleave data under the control of CPU 151 to produce code data corresponding to 
the aforementioned code data D6. 

Then, the computer apparatus 150 applies mapping to a transmission symbol 
of a 8PSK with respect to the produced code data under the control of CPU 151 to 
produce code transmission symbol corresponding to the aforementioned code data D7. 

The computer apparatus 150 records the produced code transmission symbol 
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in the hard disk or the like once, under the control of CPU 151, after which reads the 
code transmission symbol at the desired timing to output it outside through the 
communication section 159, and display the result of process on the display section 
157 as necessary. It is noted that the produced code transmission symbol can be also 
recorded on the recording medium 170 or the like. 

As described above, the computer apparatus 150 is able to realize the code 
process in the aforementioned coding apparatus 1 by executing the code program. 

Next, decoding process in the computer apparatus 150 will be described. In the 
computer apparatus 1 50, for example, when a user carries out predetermined operation 
for executing a decode program, a control signal indicative of contents of operation 
is supplied to CPU 151 by the input section 158. In response theereto, the computer 
apparatus 150 loads a decode program to RAM 1 53 to execute it by CPU 151, receives 
the program from the outside through the communication section 159 to decode a 
reception word corresponding to the aforementioned reception word D8 and being 
recorded in the hard disk or the like and display the result of process or the like on the 
display section 157 as necessary. 

The decoded program is also provided, for example, by the recording medium 
1 70, similar to the code program, and may be read directly from the recording medium 
1 70 under the control of CPU 1 5 1 , or one recorded in the hard disk once may be read. 
The code program may be stored in advance in ROM 152. 

Concretely, the computer apparatus 150, when a code program is executed by 
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CPU 1 50, carries out MAP decoding, for example, based on the BCJR logarithm with 
respect to a reception word read out of the hard disk, or a reception word received 
through the communication section 159, under the control of CPU 151, to thereby 
carry out soft-output decoding of inner codes to produce extrinsic information 
corresponding to the aforementioned extrinsic infonnation D10. 

Continuously, the computer apparatus 150 applies a deinterleave to the 
produced extrinsic infonnation under the control of CPU 151 to produce priori 
probability information corresponding to the aforementioned extrinsic infonnation 
Dll. 

Continuously, the computer apparatus 150 carries out MAP decoding based , 
for example, on the BCJR logarithm with respect to the produced priori probability 
infonnation under the control of CPU 151 to thereby carry out soft-output decoding 
of middle codes to produce extrinsic infonnation corresponding to the aforementioned 
extrinsic infonnation D 13 and D 14. 

Continuously, the computer apparatus 150 applies deinterleave to extrinsic 
information corresponding to the aforementioned extrinsic information D 1 3 under the 
control of CPU151 to produce priori probability information corresponding to the 
aforementioned priori probability infonnation D 1 5 , and applies interleave to extrinsic 
infonnation corresponding to the aforementioned extrinsic infonnation D 14 to produce 
priori probability infonnation corresponding to the aforementioned priori probability 
information D9. 
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Continuously, the computer apparatus 150 carries out, for example, MAP 
decoding based on the BCJR logarithm with respect to priori probability information 
corresponding to the aforementioned priori probability information D15 to thereby 
carry out soft-output decoding of outer codes to produce extrinsic information 
corresponding to the aforementioned extrinsic information D 18, and applies interleve 
to the extrinsic information to produce priori probability information corresponding 
to the aforementioned priori probability information D12. 

Then, the computer apparatus 150 carries out such a decoding operation as 
described above iteratively by the predetermined number of times, for example, such 
as several times or scores of times, and outputs decoding data of hard-output on the 
basis of extrinsic information of soft-output obtained as a result of the predetermined 
number of times of decoding operation corresponding to the aforementioned extrinsic 
information D17. 

The computer apparatus 150 records the obtained decode data in the hard disk 
or the like under the control of CPU 151, and displays the result of process or the like 
on the display section 157. The obtained decode data can be also recorded in the 
recording medium 170 or the like. 

As described above, the computer apparatus 150 is able to realize the decoding 
process in the aforementioned decoding apparatus 3 by executing the decode program. 

It is noted of course that the present invention can be changed suitably within 
the scope not departing from the gist thereof. 
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As described above in detail, coding apparatus according to the present 
invention, a first coding means carries out coding whose code rate is k/(k+l) with 
respect to data of k-bit input; a first interleaving means interleaves order of bits 
constituting data comprising a bit series of (k+1) bits coded by the first coding means; 
at least one or more second coding means and second interleaving means carry out 
coding whose code rate is 1 with respect to data of (k+1) bit input and interleave 
order of bits constituting data comprising a bit series of (k+1) bits code ; a third coding 
means carries out coding whose code rate is 1 with respect to data of (k+1) bit input; 
and a mapping means maps data of (k+1) bit coded by the third coding means to a 
transmission symbol of a predetermined modulation. 

Further, in the coding method or coded program thereof according to the 
present invention, a first coding step carries out coding whose code rate is k/(k+l) 
with respect to data of k-bit input; a first interleaving step interleaves and rearranges 
order of bits constituting data comprising a bit series of (k+1) bits coded by the first 
coding step; a coding processing step carries out at least one or more processes 
including a second coding step for carrying out coding whose code rate is 1 with 
respect to data of (k+1) bit input; and a second interleaving step interleaves order of 
bits constituting data comprising a bit series of (k+1) bits coded by the second coding 
step; a third coding step carries out coding whose code rate is 1 with respect to data 
of (k+1) bit processed by the coding processing step; a mapping step maps data of 
(k+1) bit code by the third coding step to a transmission symbol of a predetermined 
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modulation. 

Furthermore, in the decoding apparatus according to the present invention, a 
first soft-output decoding means carries out soft-output decoding using a reception 
word which is a soft-input input, and priori probability information with respect to 
information bits of (k+1) bits which is a soft-input input; at least one or more first 
deinterleaving means, second soft-output decoding means and third deinterleaving 
means rearranges data of (k+1) bit of a soft-input input, carry out soft-output decoding 
using priori probability information with respect to code bits of (k+1) bits which are 
a soft-input output from the first deinterleaving means, and priori probability 
information with respect to information bits of (k+1 ) bits which are a soft-input input, 
and interleave order of bits constituting data comprising a bit series of (k+1) pieces of 
a soft-input output from the respective ones of the at least one or more second soft- 
output decoding means on the basis of the same exchange position information as that 
of the second interleaving means; a second deinterleaving means rearranges data of 
(k+1) bits of a soft-input input; a third soft-output decoding means carries out soft- 
output decoding using priori probability information with respect to code bits of (k+1) 
bits which are a soft-input output from the second deinterleaving means, and priori 
probability information with respect to information bits of (k+1 ) bits which are a soft- 
input input; and a fourth interleaving means interleaves order of bits constituting data 
comprising a bit series of (k+1 ) pieces of a soft-input output from the third soft-output 
decoding means on the basis of the same exchange position information as that of the 
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first interleaving means. 

Further, in the decoding method or coded program thereof according to the 
present invention as described above, a first soft-output decoding step carries out soft- 
output decoding using a reception word which is a soft-input input, and priori 
probability information with respect to information bits of (k+1) bits which is a soft- 
input input; a second deinterleaving step rearranges data of (k+1) bits of a soft-input 
processed by the decoding processing step; a third soft-output decoding step carries 
out soft-output decoding using priori probability information with respect to code bits 
of (k+1) bits which are a soft-input output rearranged by the second deinterleaving 
step, and priori probability information with respect to information bits of (k+1) bits 
which are a soft-input input; and a fourth interleaving step interleaves order of bits 
constituting data comprising a bit series of (k+1) pieces of a soft-input output from the 
third soft-output decoding step on the basis of the same exchange position information 
as that of the first interleaving step. 
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